Bit-plane coding

ABSTRACT

A coding efficiency improvement is achieved by performing bit-plane coding in a manner so that coefficient groups for which the set of coded bit-planes is predictively signaled in the datastream, are grouped in two group sets and if a signal is spent in the datastream which signals, for a group set, whether the set of coded bit-planes of all coefficient groups of the respective group set are empty, i.e. all coefficients within the respective group sets are insignificant. In accordance with another aspect, a coding efficiency improvement is achieved by providing bit-plane coding with group-set-wise insignificant signalization according to the first aspect as a coding option alternative relative to the signalization for group sets for which it is signaled that there is no coded prediction residual for the coded bit-planes for the claim groups within the respective group set.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of copending International PatentApplication No. PCT/EP2018/056122 filed Mar. 12, 2018, which claimspriority from European Patent Application No. EP 17 180 617.7, which wasfiled on Jul. 10, 2017, and is incorporated herein in its entirety byreference.

The present application concerns bit-plane coding such as bit-planepicture coding for coding of still pictures and/or videos.

BACKGROUND OF THE INVENTION

In bit-plane coding, one seeks to try to reduce the coding amount byrestricting the bit-planes coded to a fraction of the total amount ofavailable bit-planes. Mostly, the bit-plane coding is performed ontransform coefficients, i.e. coefficients of a transform of the actualdata to be coded such as a spectral decomposition transform of apicture. Such a transform already “condenses” the overall signal energyinto a smaller amount of samples, namely transform coefficients, andresults in neighboring transform coefficients sharing similar statisticsas far as the position of the most significant bit-plane among theavailable bit-planes is concerned, i.e. the most significant bit-planehaving a non-zero bit in the respective transform coefficient.Accordingly, in the currently envisaged version of the upcoming JPEG XS,the transform coefficients representing a picture are coded in units ofgroups of transform coefficients with the datastream spending a syntaxelement per transform coefficient group which indicates the largest,i.e. most significant, bit-plane populated by the bits of the transformcoefficients within that group, called GCLI, greatest coded line index.Alternative names are MSB Position or bitplane count. This GCLI value iscoded in the datastream in a predictive manner such as using spatialprediction from neighboring transform coefficient groups. Such GCLIgroups, in turn, are grouped into SIG groups and for each such SIG groupof GCLI groups, a flag is spent in the datastream signaling the casewhere the prediction residual coded for the GCLI values is all zero forall the GCLI groups within an SIG group. If such a flag signals that allprediction residuals for GCLI are zero within an SIG group, no GCLIprediction residuals need to be transmitted and bitrate is saved.

However, there is still an ongoing wish to improve the coding efficiencyof the just-outlined bit-plane concept in terms of, for instance,compression and/or coding complexity.

SUMMARY

According to an embodiment, a device may have: a decoder configured todecode transform coefficients from a data stream, the transformcoefficients being grouped into coefficient groups, the coefficientgroups being grouped into group sets, the decoder being configured toderive from the data stream an indication of a significance coding mode;derive from the data stream information which identifies a first subsetof group sets for which a significance coding mode is not to be used,and a second subset of group sets for which the significance coding modeis to be used; for each group set out of the first subset, for eachcoefficient group of the respective group set, identify a first set ofcoded bit planes by deriving a first prediction for the first set ofcoded bit planes based on a first previously decoded coefficient group,correcting the first prediction using a first prediction residualderived from the data stream so as to acquire a corrected prediction forthe first set of coded bit planes, deriving bits of the respectivecoefficient group within the corrected prediction for first set of codedbit planes from the data stream; if the significance coding mode is afirst mode, for each group set out of the second subset, for eachcoefficient group of the respective group set, identify a second set ofcoded bit planes by deriving a second prediction for the second set ofcoded bit planes based on a second previously decoded coefficient group,and derive bits of the respective coefficient group within theprediction for the second set of coded bit planes from the data stream;and if the significance coding mode is a second mode, for each group setof the second subset, inherit that for each coefficient group ofrespective group set, coefficients of the respective coefficient groupare insignificant.

According to another embodiment, a device may have: an encoderconfigured to encode transform coefficients into a data stream, thetransform coefficients being grouped into coefficient groups, thecoefficient groups being grouped into group sets, the encoder beingconfigured to signal in the data stream a significance coding mode to bea first mode or a second mode, insert into the data stream informationwhich identifies a first subset of group sets for which the significancecoding mode is not to be used, and a second subset of group sets forwhich the significance coding mode is to be used; for each group set outof the first subset, for each coefficient group of the respective groupset, identify a first set of coded bit planes in the data stream byderiving a first prediction for the first set of coded bit planes basedon a first previously coded coefficient group, insert into the datastream a first prediction residual for correcting the first predictionso as to acquire a corrected prediction for the first set of coded bitplanes, insert bits of the respective coefficient group within thecorrected prediction for the first set of coded bit planes into the datastream; if the significance coding mode is the first mode, for eachgroup set out of the second subset, for each coefficient group of therespective group set, identify a second set of coded bit planes byderiving a second prediction for the second set of coded bit planesbased on a second previously coded coefficient group, and insert bitswithin the prediction for the second set of coded bit planes into thedata stream; and wherein the significance coding mode being the secondmode signals that, for each group set of the second subset, for eachcoefficient group of respective group set, coefficients of therespective coefficient group are insignificant.

According to another embodiment, a device may have: a decoder configuredto decode transform coefficients from a data stream, the transformcoefficients being grouped into coefficient groups, the coefficientgroups being grouped into group sets, the decoder being configured toderive from the data stream information which identifies a first subsetof group sets for which a significance coding mode is not to be used,and a second subset of group sets for which the significance coding modeis to be used; for each group set out of the first subset, for eachcoefficient group of the respective group set, identify a first set ofcoded bit planes by deriving a first prediction for the first set ofcoded bit planes based on a first previously decoded coefficient group,correcting the first prediction using a first prediction residualderived from the data stream so as to acquire a corrected prediction forthe first set of coded bit planes, derive bits of the respectivecoefficient group within the corrected prediction for first set of codedbit planes from the data stream at a code rate of 1; for each group setof the second subset, inherit that for each coefficient group ofrespective group set, coefficients of the respective coefficient groupare insignificant.

According to another embodiment, a device may have: an encoderconfigured to encode transform coefficients into a data stream, thetransform coefficients being grouped into coefficient groups, thecoefficient groups being grouped into group sets, the encoder beingconfigured to insert into the data stream information which identifies afirst subset of group sets for which the significance coding mode is notto be used, and a second subset of group sets for which the significancecoding mode is to be used; for each group set out of the first subset,for each coefficient group of the respective group set, identify a firstset of coded bit planes by deriving a first prediction for the first setof coded bit planes based on a first previously coded coefficient group,insert into the data stream a first prediction residual for correctingthe first prediction so as to acquire a corrected prediction for thefirst set of coded bit planes, insert bits of the respective coefficientgroup within the corrected prediction for the first set of coded bitplanes into the data stream at a code rate of 1, wherein, for each groupset of the second subset, for each coefficient group of respective groupset, coefficients of the respective coefficient group are insignificant.

According to an embodiment, a method for decoding transform coefficientsfrom a data stream, the transform coefficients being grouped intocoefficient groups, the coefficient groups being grouped into groupsets, may have the steps of: deriving from the data stream an indicationof a significance coding mode; deriving from the data stream informationwhich identifies a first subset of group sets for which a significancecoding mode is not to be used, and a second subset of group sets forwhich the significance coding mode is to be used; for each group set outof the first subset, for each coefficient group of the respective groupset, identifying a first set of coded bit planes by: deriving a firstprediction for the first set of coded bit planes based on a firstpreviously decoded coefficient group, correcting the first predictionusing a first prediction residual derived from the data stream so as toacquire a corrected prediction for the first set of coded bit planes,deriving bits of the respective coefficient group within the correctedprediction for first set of coded bit planes from the data stream; ifthe significance coding mode is a first mode, for each group set out ofthe second subset, for each coefficient group of the respective groupset, identifying a second set of coded bit planes by deriving a secondprediction for the second set of coded bit planes based on a secondpreviously decoded coefficient group, and deriving bits of therespective coefficient group within the prediction for the second set ofcoded bit planes from the data stream; and if the significance codingmode is a second mode, for each group set of the second subset,inheriting that for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant.

According to an embodiment, a method for encoding transform coefficientsinto a data stream, the transform coefficients being grouped intocoefficient groups, the coefficient groups being grouped into groupsets, may have the steps of: signaling in the data stream a significancecoding mode to be a first mode or a second mode, inserting into the datastream information which identifies a first subset of group sets forwhich the significance coding mode is not to be used, and a secondsubset of group sets for which the significance coding mode is to beused; for each group set out of the first subset, for each coefficientgroup of the respective group set, identifying a first set of coded bitplanes in the data stream by deriving a first prediction for the firstset of coded bit planes based on a first previously coded coefficientgroup, inserting into the data stream a first prediction residual forcorrecting the first prediction so as to acquire a corrected predictionfor the first set of coded bit planes, inserting bits of the respectivecoefficient group within the corrected prediction for the first set ofcoded bit planes into the data stream; if the significance coding modeis the first mode, for each group set out of the second subset, for eachcoefficient group of the respective group set, identifying a second setof coded bit planes by: deriving a second prediction for the second setof coded bit planes based on a second previously coded coefficientgroup, and inserting bits within the prediction for the second set ofcoded bit planes into the data stream; and wherein the significancecoding mode being the second mode signals that, for each group set ofthe second subset, for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant.

According to an embodiment, a method for decoding transform coefficientsfrom a data stream, the transform coefficients being grouped intocoefficient groups, the coefficient groups being grouped into groupsets, may have the steps of: deriving from the data stream informationwhich identifies a first subset of group sets for which a significancecoding mode is not to be used, and a second subset of group sets forwhich the significance coding mode is to be used; for each group set outof the first subset, for each coefficient group of the respective groupset, identifying a first set of coded bit planes by: deriving a firstprediction for the first set of coded bit planes based on a firstpreviously decoded coefficient group, correcting the first predictionusing a first prediction residual derived from the data stream so as toacquire a corrected prediction for the first set of coded bit planes,deriving bits of the respective coefficient group within the correctedprediction for first set of coded bit planes from the data stream at acode rate of 1; for each group set of the second subset, inheriting thatfor each coefficient group of respective group set, coefficients of therespective coefficient group are insignificant.

According to an embodiment, a method for encoding transform coefficientsinto a data stream, the transform coefficients being grouped intocoefficient groups, the coefficient groups being grouped into groupsets, may have the steps of: inserting into the data stream informationwhich identifies a first subset of group sets for which the significancecoding mode is not to be used, and a second subset of group sets forwhich the significance coding mode is to be used; for each group set outof the first subset, for each coefficient group of the respective groupset, identifying a first set of coded bit planes by deriving a firstprediction for the first set of coded bit planes based on a firstpreviously coded coefficient group, insert into the data stream a firstprediction residual for correcting the first prediction so as to acquirea corrected prediction for the first set of coded bit planes, insertingbits of the respective coefficient group within the corrected predictionfor the first set of coded bit planes into the data stream at a coderate of 1, wherein, for each group set of the second subset, for eachcoefficient group of respective group set, coefficients of therespective coefficient group are insignificant.

An embodiment may have a data stream generated by a method for encodingtransform coefficients into a data stream, the transform coefficientsbeing grouped into coefficient groups, the coefficient groups beinggrouped into group sets, the method including: signaling in the datastream a significance coding mode to be a first mode or a second mode,inserting into the data stream information which identifies a firstsubset of group sets for which the significance coding mode is not to beused, and a second subset of group sets for which the significancecoding mode is to be used; for each group set out of the first subset,for each coefficient group of the respective group set, identifying afirst set of coded bit planes in the data stream by: deriving a firstprediction for the first set of coded bit planes based on a firstpreviously coded coefficient group, inserting into the data stream afirst prediction residual for correcting the first prediction so as toacquire a corrected prediction for the first set of coded bit planes,inserting bits of the respective coefficient group within the correctedprediction for the first set of coded bit planes into the data stream;if the significance coding mode is the first mode, for each group setout of the second subset, for each coefficient group of the respectivegroup set, identifying a second set of coded bit planes by: deriving asecond prediction for the second set of coded bit planes based on asecond previously coded coefficient group, and inserting bits within theprediction for the second set of coded bit planes into the data stream;and wherein the significance coding mode being the second mode signalsthat, for each group set of the second subset, for each coefficientgroup of respective group set, coefficients of the respectivecoefficient group are insignificant.

Another embodiment may have a data stream generated by a method forencoding transform coefficients into a data stream, the transformcoefficients being grouped into coefficient groups, the coefficientgroups being grouped into group sets, the method including: insertinginto the data stream information which identifies a first subset ofgroup sets for which the significance coding mode is not to be used, anda second subset of group sets for which the significance coding mode isto be used; for each group set out of the first subset, for eachcoefficient group of the respective group set, identifying a first setof coded bit planes by: deriving a first prediction for the first set ofcoded bit planes based on a first previously coded coefficient group,insert into the data stream a first prediction residual for correctingthe first prediction so as to acquire a corrected prediction for thefirst set of coded bit planes, inserting bits of the respectivecoefficient group within the corrected prediction for the first set ofcoded bit planes into the data stream at a code rate of 1, wherein, foreach group set of the second subset, for each coefficient group ofrespective group set, coefficients of the respective coefficient groupare insignificant.

Another embodiment may have a non-transitory digital storage mediumhaving a computer program stored thereon to perform the method fordecoding transform coefficients from a data stream, the transformcoefficients being grouped into coefficient groups, the coefficientgroups being grouped into group sets, the method including: derivingfrom the data stream an indication of a significance coding mode;deriving from the data stream information which identifies a firstsubset of group sets for which a significance coding mode is not to beused, and a second subset of group sets for which the significancecoding mode is to be used; for each group set out of the first subset,for each coefficient group of the respective group set, identifying afirst set of coded bit planes by: deriving a first prediction for thefirst set of coded bit planes based on a first previously decodedcoefficient group, correcting the first prediction using a firstprediction residual derived from the data stream so as to acquire acorrected prediction for the first set of coded bit planes, derivingbits of the respective coefficient group within the corrected predictionfor first set of coded bit planes from the data stream; if thesignificance coding mode is a first mode, for each group set out of thesecond subset, for each coefficient group of the respective group set,identifying a second set of coded bit planes by deriving a secondprediction for the second set of coded bit planes based on a secondpreviously decoded coefficient group, and deriving bits of therespective coefficient group within the prediction for the second set ofcoded bit planes from the data stream; and if the significance codingmode is a second mode, for each group set of the second subset,inheriting that for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant, whensaid computer program is run by a computer.

Another embodiment may have a non-transitory digital storage mediumhaving a computer program stored thereon to perform the method fordecoding transform coefficients from a data stream, the transformcoefficients being grouped into coefficient groups, the coefficientgroups being grouped into group sets, the method including: derivingfrom the data stream information which identifies a first subset ofgroup sets for which a significance coding mode is not to be used, and asecond subset of group sets for which the significance coding mode is tobe used; for each group set out of the first subset, for eachcoefficient group of the respective group set, identifying a first setof coded bit planes by: deriving a first prediction for the first set ofcoded bit planes based on a first previously decoded coefficient group,correcting the first prediction using a first prediction residualderived from the data stream so as to acquire a corrected prediction forthe first set of coded bit planes, deriving bits of the respectivecoefficient group within the corrected prediction for first set of codedbit planes from the data stream at a code rate of 1; for each group setof the second subset, inheriting that for each coefficient group ofrespective group set, coefficients of the respective coefficient groupare insignificant, when said computer program is run by a computer.

In accordance with a first aspect, the present application is based on afinding that a coding efficiency improvement may be achieved ifbit-plane coding is performed in a manner so that coefficient groups forwhich the set of coded bit-planes is predictively signaled in thedatastream, are grouped in two group sets and if a signal is spent inthe datastream which signals, for a group set, whether the set of codedbit-planes of all coefficient groups of the respective group set areempty, i.e. all coefficients within the respective group sets areinsignificant. By this measure, spending unnecessary bits for non-zeroprediction residuals for coding the set of coded bit-planes forcoefficient groups within a certain group set may be avoided in caseswhere, nevertheless, all the transform coefficients within allcoefficient groups within the certain group set are insignificant,thereby tending to result in an improved compression. Beyond this, asfar as the encoder is concerned, the determination whether transformcoefficients are insignificant or not, i.e. whether the set of codedbit-planes, i.e. the non-zero bit-planes, are all beneath a quantizationthreshold, may be determined for each group set in parallel, i.e.independent from each other, thereby rendering easier a parallelimplementation using the sort of group set-wise insignificantsignalization.

In accordance with another aspect of the present application, it hasbeen found out that a coding efficiency improvement may be achieved ifbit-plane coding with group-set-wise insignificant signalizationaccording to the first aspect discussed above is provided as a codingoption alternative relative to the signalization for group setsdiscussed in the introductory portion of the specification according towhich it may be signaled for a group set that there is no codedprediction residual for the coded bit-planes for the claim groups withinthe respective group set. To this, in accordance with the second aspect,the datastream provides information which identifies a first subset ofgroup sets for which a significance coding mode is not to be used and asecond subset of group sets for which the significance coding mode is tobe used. The first subset of group sets is coded “normally”, i.e. thedatastream provides prediction residuals for the coded bit-planes of thecoefficient groups of such group set and, if significant, bits withinthe coded bit-planes are coded in the datastream. For the second subsetof group sets, the datastream comprises an indication or specificationof the significance coding mode. In other words, this indication orspecification signals to the decoder as to how the second subset ofgroup sets are to be treated or, differently speaking, as to how theidentification of the second subset of group sets is to be interpreted.A first mode of the significance coding mode corresponds to theinterpretation according to which the prediction residual for the codedbit-plane signalization for the coefficient groups within such group setis zero. To this end, in accordance with a first significance codingmode type, merely the prediction residual signalization for the codedbit-plane signalization is omitted for the second subset of group sets.If the significance coding mode is indicated to be a second mode, thenthe group sets of the second subset are treated as collections ofinsignificant coefficients. To this end, the decoder inherits that foreach coefficient group of such a group set, its coefficients areinsignificant. According to this second aspect, the encoder is providedwith the opportunity to switch between both significance coding modeoptions and the encoder may exploit this freedom in order to select thecoding mode leading to a higher coding efficiency. Beyond this, however,providing the datastream with the opportunity to let the decoder know asto which significance coding mode option has been used, provides thedesign of the encoder side with the opportunity to choose thesignificance coding mode option more suitable for the intendedimplementation of the encoder side. For instance, when there is a highinterest in achieving higher parallelism, then the insignificancesignalization mode, i.e. second mode, may be used, while the first modemay be used in case of a single-thread implementation of the encoder.That is, the encoder may be implemented to operate merely in one of bothmode types, chosen to be adapted to the encoder's implementation.Favorably, decoder complexity does not significantly differ between bothmode types of the significance coding mode.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention will be detailed subsequentlyreferring to the appended drawings, in which:

FIG. 1 shows a block diagram of a decoder operation of JPEG XS, ascurrently envisaged;

FIG. 2 shows a schematic diagram illustrating a decomposition of apicture 12 into transform coefficients using a wavelet transform as anexample for the object of bit-plane coding, namely the transformcoefficients;

FIG. 3 shows a schematic diagram illustrating bit plane coding oftransform coefficients in units of coefficient groups with usingprediction-based coding of the set of coded bit planes by GCLI deltacoding;

FIG. 4 shows a schematic diagram illustrating a subdivision of a wavelettransform into precincts;

FIG. 5 shows a schematic diagram illustrating a composition of a groupset out of coefficient groups in order to illustrate the significancecoding mode;

FIGS. 6.1 to 6.32 show PSNR simulation results obtained by bit-planecoding using RSF, i.e. a coding mode signaling zero prediction residualfor the coded bitplane signaling, CSF, a coding mode signaling all-zeroinsignificance for the related coefficients, or a combination thereof,i.e. the case where both coding modes are available for the encoder toswitch therebetween;

FIG. 7 shows a block diagram of an encoder according to an embodiment;

FIG. 8 shows a block diagram of a decoder in accordance with anembodiment;

FIG. 9 shows an encoder in accordance with an embodiment, wherein theencoder uses CSF coding modes;

FIG. 10 shows a block diagram of a decoder fitting to the encoder ofFIG. 9;

FIG. 11 shows a block diagram of an encoder using RSF coding mode withforming a datastream indicating RSF coding mode usage;

FIG. 12 shows a block diagram of a decoder capable of handling adatastream indicating by way of indication either one of CSF and RSFusage; and

FIG. 13 shows a pseudocode for illustrating an example for forming thedatastream including an indication of RSF or CSF usage.

DETAILED DESCRIPTION OF THE INVENTION

The following description of embodiments of the present applicationstarts with a brief presentation of the current status of the JPEG XSstandardization process, i.e. a currently discussed version for JPEG XS,whereupon it is outlined as to how this version could be modified inorder to end-up into embodiments of the present application.Thereinafter, these embodiments are broadened in order to result intofurther embodiments described separately, but including individualreferences to specific details discussed before.

FIG. 1 provides an example of a decoding process currently envisaged forJPEG XS to which embodiments of the present application may be appliedas described later on. As will become clear from the broadenedembodiments described later, the present application is not limited tothis kind of decoding process and the correspond coding process.Nevertheless, FIG. 1 assists the skilled reader in obtaining a betterunderstanding of concepts of the present application.

According to FIG. 1, codestream decoding is grouped into a syntaxanalysis part in block 1, an entropy-decoding stage consisting ofmultiple blocks 2.1 to 2.4, an inverse quantization in block 3, aninverse wavelet transformation in block 4 and an inverse multiplecomponent decorrelation in block 5. In block 6, sample values arescaled, a DC offset is added, and they are clamped to their nominalranges.

In block 1, the decoder analyzes the codestream syntax and retrievesinformation on the layout of the sampling grid, and the dimensions ofso-called slices and precincts.

Sub-packets of entropy-coded data segment of the codestream are thendecoded to significant information, sign information, MSB positioninformation (also called GCLI information) and, using all thisinformation, wavelet coefficient data. This operation is performed inblocks 2.1 to 2.4 in FIG. 1.

Image and video compression typically applies a transform before runningentropy coding. Reference [7], for instance, uses a block-basedprediction, while reference [4], [3], [5], [6] advocate for wavelettransforms. A wavelet is used in the case of FIG. 1, but again, FIG. 1merely serves as an example and the same applies with respect to theusage of wavelet transform.

Such a wavelet transform is depicted in FIG. 2. It decomposes an imageinto a number of subbands. Each subband represents a spatially downsampled and sub-band-specifically spectrally bandpass-filtered versionof the picture 12. As depicted in FIG. 2, the number of horizontaldecompositions might be different from the number of verticaldecompositions. In each decomposition step, the low-pass subband of theprevious decomposition is further decomposed. The L5 subband, forinstance, represents a subsampled version of the image, while the othersubbands contain the detail-information.

After the frequency transform, the coefficients of the subbands areentropy-coded. In other words, g≥1 coefficients of a subband ABm, withA, B∈{L, H}, m∈N, are arranged into a coefficient group. Then the mostsignificant non-zero bit plane of the coefficient group is signaled,followed by the raw data bits. More details on the coding technique areexplained in the following.

FIG. 3 illustrates the principle of GCLI coding which ends-up intosyntax elements, the decoding of which, for instance, block 2.2 of FIG.1 attends to. Hence, the GCLI coding is about coding the mostsignificant bit positions and accordingly concerns the indication of thecoded bit planes. This is done in the following manner. A number ofcoefficients which number is larger than 1, and with the coefficientsbelonging to the same subband of a frequency transform, are combinedinto a group which is, from now on, called a coefficient group. See, forinstance, FIG. 2. The wavelet transform 10 depicted therein is anexample for a transform of a picture 12. Again, a wavelet transform ismerely an example for transforms for which embodiments of the presentapplication would be applicable. Instead of coding the values of thesamples or pixels 14 of picture 12 directly, the coding is performed onthe transform coefficients 16 of transform 10. FIG. 3 assumes that acoefficient group is composed of four coefficients. The number is,however, chosen merely for illustration purposes and may be chosendifferently. FIG. 2 illustrates that, for instance, such a coefficientgroup 18 comprises four spatially neighboring transform coefficients 16all of which belong to the same subband of transform 10. FIG. 2illustrates that the coefficients 16 comprised in one coefficient group18 horizontally neighbor each other, but this is also merely an exampleand the grouping of coefficients 16 into coefficient groups 18 may bedone differently. FIG. 3 illustrates the bit representation of eachcoefficient of a first coefficient group at the left-hand side at 20 andfor a second coefficient group at 22. The bits of the absolute value ofeach coefficient are spread for each coefficient along a column.Accordingly, four columns are shown at 20 and 22, respectively. Each bitbelongs to a certain bit plane wherein the lowest bit in FIG. 3 belongsto the least significant bit plane, while the upper most bits belong tothe most significant bit plane. For illustration purposes, eightavailable bit planes are shown in FIG. 3, but the number may bedifferent. In addition to the magnitude bits 24 of the transformcoefficients, FIG. 3 shows for each coefficient a sign bit 26 above thecorresponding magnitude bits. The GCLI coding is now explained withrespect to FIG. 3 in more detail.

As already outlined, the coefficients are represented in sign-magnituderepresentation. The largest coefficient in a respective coefficientgroup determines the number of active bit planes for this coefficientgroup. A bit plane is called active, if at least one coefficient bit 24of the bit plane itself or any higher bit plane (bit plane representinga larger number) is unequal to zero. The number of active bit planes isgiven by the so-called GCLI value, i.e. greatest coded line index. Forcoefficient group 20, for instance, the GCLI is 6 while for the secondcoefficient group 22, the GCLI is exemplarily 7. A GCLI value of 0 wouldmean that no bit planes are active, and hence the complete coefficientgroup would be 0. This situation is known as insignificant GCLI, andsignificant GCLI vice-versa. In order to achieve compression, only theactive bit planes are placed into the bitstream, i.e. are coded.

For lossy encoding, some of the bit planes need possibly to be truncatedsuch that the number of bit planes transmitted for a coefficient groupis smaller than the GCLI value. This truncation is specified by theso-called GTLI, i.e. the greatest trimmed line index. An alternativename is truncation position. A GTLI of zero corresponds to notruncation. A GTLI value of 1 means that the number of transmitted bitplanes for a coefficient group is 1 less than the GCLI value. In otherwords, the GTLI defines the smallest bit plane position that is includedin the bitstream. In case of a simple dead zone quantization scheme, thetransmitted bit planes equal the bit planes of the coefficient groupwithout the truncated bit planes. In case of more advanced quantizationschemes, some information of the truncated bit planed can be “pushed”into the transmitted bit planes by modifying the quantization bins. Moredetails can be found in [6].

Since for each coefficient the number of remaining bit planes equals thedifference between the GCLI and the GTLI values, it gets obvious thatcoefficient groups whose GCLIs is smaller or equal to the GTLI value arenot contained in the bit stream. In other words, no (data) bits 24 areconveyed in the bit stream for these coefficient groups. Theircoefficients are insignificant.

The active bit planes remaining after truncation and quantization arecalled remaining bit planes in the following or, alternatively speaking,truncated GCLI. Moreover, the GTLI is also called truncation point inthe following. When the remaining bit planes is zero, the GCLI is knownas insignificant truncated GCLI.

These remaining bit planes are then transmitted as raw bits to thedecoder. Block 2.3 in FIG. 1 assumes responsibility for deriving thesebits from the bit stream. In order to enable correct decoding, thedecoder needs to know, however, the GCLI value of every coefficientgroup 18. Together with the GTLI value, which is also signaled to thedecoder, the decoder can infer the number of raw data bit planes thatare in the bit stream.

The GCLI values themselves are signaled by a variable length code thatrepresents the difference to the GCLI value of a previous coefficientgroup. This previous coefficient group can in principle be anycoefficient group that the encoder has already encoded before. Hence, itcan for instance be a horizontal or vertical neighbor group. The outputfrom the prediction is the difference in the number of remaining bitplanes between two coefficient groups, leading to a delta remaining bitplanes. FIG. 3, for instance, assumes that the left-hand coefficientgroup depicted at 20, precedes coefficient group 22 in coding order andits GCLI serves as a predictor for the GCLI of coefficient group 22.

More details are described hereinafter. Please note that GCLI valuesbeing below the GTLI value are of no interest, since the coefficientsare not contained in the bit stream in any case. Consequently, theprediction is performed in such a way that the decoder can infer whetherthe GCLI is greater than the GTLI, and if so, what is the value of theGCLI.

Please note that the method described below is agnostic to thetransmission order of the different bit stream parts. For instance, itis possible to first place the GCLI coefficients of all subbands intothe bit stream, followed by the data bits of all subbands.Alternatively, GCLI and data bits might be interleaved in thedatastream.

Coefficients of the frequency transform depicted in FIG. 2 are organizedin so-called precincts 30. This is depicted in FIG. 4. Precincts groupcoefficients of different subbands contributing to a given spatialregion 32 of the input image 12.

In order to enable the decoder to recover the signal, it should knowthat GCLI value for every coefficient group 18. According to [3],different methods are available to signal them efficiently.

In the RAW mode, the GCLI value is transmitted without any prediction.

Hence, let F₁ be the coefficient group to be encoded next. Then the GCLIvalue can be encoded by a fixed length codeword representing the value:max(GCLI(F ₁)−GTLI(F ₁),0)

In a horizontal prediction, the symbol coded is the difference betweenthe GCLI value and the value of the GCLI previously coded belonging tothe same line and the same wavelet subband, and considering the GTLI.This difference value is called residual or δ value in the following.

Let F₁ and F₂ be two horizontally neighbored coefficient groups,consisting of g>1 coefficients. Let F₂ be the coefficient group to becurrently coded. Then GCLI(F₂) can be signaled to the decoder bytransmitting a residual calculated as follows:

$\delta = \left\{ \begin{matrix}\begin{matrix}{{\max\left( {{{GCLI}\left( F_{2} \right)},{{GTLI}\left( F_{2} \right)}} \right)} -} \\{\max\left( {{{GCLI}\left( F_{1} \right)},{{GTLI}\left( F_{2} \right)}} \right)}\end{matrix} & {{{if}\mspace{14mu}{{GCLI}\left( F_{1} \right)}} > {{GTLI}\left( F_{1} \right)}} \\{{\max\left( {{{GCLI}\left( F_{2} \right)},{{GTLI}\left( F_{2} \right)}} \right)} - {{GTLI}\left( F_{2} \right)}} & {otherwise}\end{matrix} \right.$

The decoder recovers GCLI(F₂) by computing

${{GCLI}^{\prime}\left( F_{2} \right)} = {\delta + \left\{ {{\begin{matrix}{\max\left( {{{GCLI}\left( F_{1} \right)},{{GTLI}\left( F_{2} \right)}} \right)} & {{{if}\mspace{14mu}{{GCLI}\left( F_{1} \right)}} > {{GTLI}\left( F_{1} \right)}} \\{{GTLI}\left( F_{2} \right)} & {otherwise}\end{matrix}\mspace{20mu}{{GCLI}\left( F_{2} \right)}} = \left\{ \begin{matrix}{{GCLI}^{\prime}\left( F_{2} \right)} & {{{if}\mspace{14mu}{{GCLI}^{\prime}\left( F_{2} \right)}} > {{GTLI}\left( F_{2} \right)}} \\0 & {otherwise}\end{matrix} \right.} \right.}$

Please note that in horizontal prediction, typically GTLI(F₁)=GTLI(F₂).Note furthermore that δ is transmitted as a variable length code, asdescribed in [4].

In a vertical prediction between two subband lines, the result is thedifference between the GCLI value and the GCLI of the same subset ofcoefficients in the previously coded line.

Let F₁ and F₂ be two vertically neighbored coefficient groups,consisting of g>1 coefficients. Let F₂ be the coefficient group to becurrently coded. Then, GCLI(F₂) can be encoded in the same way than in ahorizontal prediction.

Vertical prediction is restricted within a slice, which is a predefinedset of contiguous lines (e.g. 64 lines). In this way, the first precinctof a slice cannot be vertically predicted.

An alternative way for vertical prediction is that instead of theprediction described above, the following prediction formula is used:δ=max(GCLI(F ₂),GTLI(F ₂))−max(GCLI(F ₁),GTLI(F ₁))

Another alternative for vertical prediction is to use a so calledbounded code:

$\delta = \left\{ \begin{matrix}{2 \cdot \left( {{\overset{\sim}{g}}_{i} - g_{i}^{*}} \right)} & {{\overset{\sim}{g}}_{i} \geq {g_{i}^{*}\bigwedge{\overset{\sim}{g}}_{i}} \leq {{2 \cdot g_{i}^{*}} - t_{i}}} \\{{2 \cdot \left( {g_{i}^{*} - {\overset{\sim}{g}}_{i}} \right)} - 1} & {{\overset{\sim}{g}}_{i} < g_{i}^{*}} \\{{\overset{\sim}{g}}_{i} - t_{i}} & {otherwise}\end{matrix} \right.$

withg _(i)*=max({tilde over (g)} _(i) ^(r) ,t _(i)){tilde over (g)} _(i)=max(g _(i) ,t _(i)){tilde over (g)} _(i) ^(r)=max(g _(i) ^(r) ,t _(i) ^(r))

with

g_(i) being the GCLI to encode

g_(i) ^(r) being the GCLI used as reference

t_(i) being the truncation to apply for g_(i)

t_(i) ^(r) being the truncation that has been applied for g_(i) ^(r)

Such a code has the property of δ≥0, such that an efficient unary codingis possible.

The same prediction method can also be applied for

$g_{i}^{*} = \left\{ \begin{matrix}{\max\left( {{\overset{\sim}{g}}_{i}^{r},t_{i}} \right)} & {{\overset{\sim}{g}}_{i}^{r} > t_{i}^{r}} \\t_{i} & {otherwise}\end{matrix} \right.$

In [1], escape codes have been used in the GCLI coding to signal asequence of coefficient groups consisting of a plurality of coefficientsall being smaller than a predefined truncation threshold. By thesemeans, coding efficiency can be improved since multiple zero coefficientgroups can be represented by one escape word instead of using a codeword per coefficient group.

While this method has the advantage of not using any overheads in termsof significance flags, computing the additional bits compared to thebits that may be needed when not using any escape code induces somecomplexity. Moreover, some coding methods do not allow to use espacecodes in an easy manner.

See, for instance, FIG. 5 shows coefficient groups 18 that might beimmediately consecutive with respect to the coding order 38 definedamong the coefficient groups 18, but this is not mandatory. According tothe just-mentioned escape coding, the GCLI value transmitted in thedatastream for coefficient group 18 could signal, by way of assuming theescape code, that its coefficients as well as the coefficients of anumber of subsequent coefficient groups 18, together forming a group set40, are all insignificant. The question as to which coefficient groups18 belong to group set 40 could be known by default or could besignaled. For example, when contiguous GCLI coefficient groups 18 haveinsignificant truncated GCLI values, they can be discarded from thecodestream to improve coding efficiency by this means, for example. Inthis spatial zero runs method, this is done by means of coding escapevalues for the first coefficient in the group set 40 beinginsignificant. However, as just-indicated, spending such coding escapevalues increases the coding complexity and is, accordingly, not suitablefor extreme low complexity cases.

According to the so-called RSF method taught in [1], the burden forcoding the GCLI values is reduced by signaling for group sets such asgroup set 40 in FIG. 5, that the insignificant truncated GCLI values ofthe coefficient groups 18 are predicted from reference GCLI valuesleading, for all of them within group set 40, to residuals equal to 0.To this end, the coefficient groups 18 are grouped into group sets 40and the datastream comprises for each group set 40 an RSF flagindicating whether the prediction residuals for the GCLI are all 0within group set 40 in which case, naturally, no prediction residualsneed to be transmitted in the datastream. However, RSF does not skip thecoding of insignificant GCLIs when their corresponding residuals are not0.

It might be that prediction residuals for the GCLIs of a set 40 arenon-zero while, however, due to truncation, all the coefficients of allcoefficient groups 18 within the respective group set 40 areinsignificant.

The embodiments described below provide an opportunity to deleteinsignificant truncated GCLIs from the codestream by modifying theinterpretation of RSF, allowing being complementary to the just-outlinedRSF method at low complexity.

This is discussed in more detail in the following.

In the RSF method discussed in [1], GCLI coefficients are arranged intogroups inside each subband, from now onwards called SIG groups. Element40 in FIG. 5 is such an SIG group, for instance. The SIG group sizemight be 8 or any other number greater than 1. That is, a SIG group 40may comprise two or more coefficient groups 18. While coefficient groups18 comprised by one SIG group 40 may, as just-outlined, belong to onesubband of the transform 10, this is not mandatory. Note that if thesubband is not a multiple of a SIG group size such as 8, then the lastcoefficients might be treated as an incomplete group.

At the beginning of the codestream for a precinct 30, for example, asequence of flags is signaled. Each flag corresponds to each SIG group40 in the precinct. If the flag is set, then it means that all GCLIresiduals corresponding to that group 40 are 0, and therefore, are notpresent in the codestream.

As mentioned before, there are situations in which the GCLIs of an SIGgroup are totally truncated (or simply 0), while their residuals are not0. This can happen, for instance, when they are predicted verticallyfrom a line or row in which the GCLIs are significant. Here, RSF do notsucceed on preventing their residuals from being signaled, when inreality it might be advantageous, given that residuals different from 0may use more budget for unary coding, for instance.

Thus, coefficient significance flags (CSF) are used in accordance withan embodiment of the present application instead of RSFs, thereby aimingat further extending the definition of RSF. By introducing a new GCLIcoding method, CSF dedicate also one flag to every SIG group 40, butthey are set whenever the GCLIs of the coefficient groups 18 of the SIGgroup 40 are all insignificant after truncation, i.e. the set of codedbit planes for these coefficient groups 18 is empty. Hence, the sameamount of flags than for RSF may be used. As described hereinafter, CSFcoding may be combined with RSF coding in the sense that both may beused in accordance with alternative coding options so that it can beselected per precinct 30 or per subband, for instance. Here, the sameflags in the data stream are interpreted to be RSFs or CSFs depending onsome additional signalization in the data stream.

TABLE 1 Example of four exemplary SIG groups and indication of how RSFand CSF would bet set for these SIG groups SIG group 0 1 2 3 Predictor 62 5 7 5 6 5 8 4 5 2 5 5 6 6 7 GCLIs GCLI 5 4 2 3 5 6 5 8 0 0 0 2 5 5 6 8values Truncated 0 0 0 0 0 1 0 3 0 0 0 0 0 0 1 3 GCLIs (GTLI = 5)Residuals −1 0 0 −2 0 0 0 0 0 0 0 0 0 −1 0 1 RSF 0 1 1 0 CSF 1 0 1 0

The table 1 shows an example and a comparison of CSF and RSF methods.For SIG group 0, CSF is selected since the truncated GCLI values are all0, while RSF flag is not given that the residuals are not 0. For SIGgroup 1, the situation is the opposite. For SIG group 2, both GCLIs andresiduals are 0 so that CSF would be one and RSF, too. And finally, inSIG group 3, neither of them is selected, i.e. RSF and CSF is set tozero.

In the following, the CSF variant is discussed further.

For example, the usage of CSF flags has an impact in that a budgetsaving per SIG group may be achieved.

Alphabets for unary coding typically dedicate 1 bit to signal a residualvalue of 0. Therefore, the budget saved by RSF is the same for everydeleted SIG group, and equals exactly to the size of the group. On theother hand, the budget overhead introduced by the method is constantthrough the image, and equals to the amount of RSF that may be used.

Regarding CSF, the budget overhead is exactly equal than for RSF. But incontrast, the peak budget saving per SIG group is equal or larger thanwith RSF. Indeed, residuals removed by CSF can be equal or different to0, so their budget can be greater or equal than the size of the group.

While RSF can be employed transparently to prediction, given that it isa post-processing (in encoder) or a pre-processing (in decoder), for CSFthe prediction modules in decoder and encoder are slightly modified.

At the encoder, whenever a SIG group is found to contain onlyinsignificant truncated GCLIs, then their coding can be completelyskipped. However, the budget computation has to do more calculations inorder to obtain the amount of bits saved by the residuals.

In the decoder, inverse prediction of those deleted GCLIs with CSF canbe also skipped and replaced by 0 instead.

In the following, picture coding using CSFs as just-outlined isdescribed in more details. To this end, some function definitions areused as follows.

Let α be a coefficient group to be encoded. Then

-   GCLI(α): Returns the GCLI value coefficient group a-   PREF(α): Returns the coefficient group used for predicting the GCLI    value of coefficient group α-   GTLI(α): Returns the GTLI value to apply for coefficient group α.    GTLI(α) thus depends on the precinct and subband of group α.-   PRED(g_(α),t_(α),g_(b),t_(b)): Returns the residual corresponding to    the prediction of GCLI g_(α) using as reference GCLI g_(b), with    GTLIs t_(α) and t_(b) respectively.-   PRED⁻¹(δ,t_(α),g_(b),t_(b)): Returns the inverse prediction    corresponding to coefficient group, using as reference GCLI g_(b),    residual δ, and with GTLIs t_(α) and t_(b) respectively.-   SIZE(s): Number of coefficient groups in one line of subband s.-   SIGGRP(α): Returns the index of the SIG group to which the    coefficient group α belongs.-   CSF(g): Returns if the CSF flag associated to SIG group g. True    means that the group is insignificant.-   RSF(g): Returns if the RSF flag associated to SIG group g. True    means that the group is insignificant.-   SIGSIZE(s): SIG group size, which can be different per subband.

A pseudocode for managing CSF is provided below.

The decoding of GCLI values of a subband is done as follows.

When using CSF, the decoder can be described as stated below. For asubband s, the set of values GCLI(a_(i)) for coefficient groups a_(i) isdecoded as follows:

for 0 ≤ i < SIZE(s) if CSF(SIGGRP(a_(i))) # if STG flag is set, missingGCLI GCLI(a_(i)) ← 0 else # otherwise, decode GCLI δ′ = vlc_decode( ) #unary decode a delta value  GCLI(a_(i)) ←PRED⁻¹ (δ′, GTLI(a_(i)),GCLI(PREF(a_(i))),  GTLI(PREF(a_(i)))) end if end for

The encoding of GCLI values of a subband is done as follows.

Let define the GTLI from which all GCLIs of a SIG group becomeinsignificant, as follows:

${{GTLI}_{csf}(g)} = {{\max\limits_{g = {{SIGGRP}{(a_{i})}}}\left( {{GCLI}\left( a_{i} \right)} \right)} = {\max\limits_{a_{i} \in g}\left( {{GCLI}\left( a_{i} \right)} \right)}}$

That is, the maximum GCLI value of the group. Thus, the encoding ofcoefficient groups a_(i) of subband s can be performed as follows:

for 0 ≤ i < SIZE(s) if GTLI(a_(i)) ≥ GTLI_(csf)(SIGGRP(a_(i))) # ifinsignificant truncated GCLI CSF(SIGGRP(a_(i))) ← True # just update theflag, don't encode else # otherwise, encode encode(PRED (GCLI(a_(i)),GTLI(a_(i)), GCLI(PREF(a_(i))), GTLI(PREF(a_(i))))) CSF(SIGGRP(a_(i))) ←False end if end for

Compared thereto, a pseudocode for managing RSF is provided below, as areference.

First, the decoding of GCLI values of a subband is inspected.

When using RSF, the decoder can be described as stated below. For asubband s, the set of values GCLI(a_(i)) for coefficient groups (a_(i))is decoded as follows:

for 0 ≤ i < SIZE(s) if RSF(SIGGRP(a_(i))) # if STG flag is set, missingGCLI δ′ ← 0 else # otherwise, decode GCLI δ′ - vlc_decode( ) # unarydecode a delta value end if GCLI(a_(i)) ←PRED⁻¹ (δ′, GTLI(a_(i)),GCLI(PREF(a_(i))), GTLI(PREF(a_(i)))) end for

The encoding of GCLI values of a subband in case if using RSF is asfollows.

Let define the GTLI from which all residuals of a SIG group becomeinsignificant, as follows:

${{GTLI}_{rsf}(g)} = {\max\limits_{g = {{SIGGRP}{(a_{j})}}}\left( {\min\left\{ {\left. T_{j} \middle| {\forall{T \geq {T_{j}\text{:}\mspace{14mu}{{PRED}\left( {{{GCLI}\left( a_{j} \right)},T_{j},{{GCLI}\left( {{PREF}\left( a_{j} \right)} \right)},{{GTLI}\left( {{PREF}\left( a_{j} \right)} \right)}} \right)}}}} \right. = 0} \right\}} \right)}$

Thus, the encoding of coefficient groups a₁ of subband s can beperformed as follows:

for 0 ≤ i < SIZE(s) if GTLI(a_(i)) ≥ GTLI_(rsf)(SIGGRP(a_(i))) # ifinsignificant truncated GCLI RSF(SIGGRP(a_(i))) ← True # just update theflag, don't encode Else # otherwise, encode encode(PRED (GCLI(a_(i)),GTLI(a_(i)), GCLI(PREF(a_(i))), GTLI(PREF(a_(i))))) RSF(SIGGRP(a_(i))) ←False end if end for

A switching between coefficient and residual significance flags could besupported. As explained above, coefficient significance flags canindicate the presence of a sequence of coefficient groups (so called SIGgroup) that are zero after quantization, even when their predictionresiduals are not zero. Placing the code words representing theprediction residuals into the bit stream can be avoided by setting thesignificance information or significance flag representing the sig groupcorrespondingly, increasing thus the coding efficiency.

Residual significance flags, on the other hand, signal the presence of aquantized SIG group having all zero prediction residuals. In otherwords, in case all quantized coefficients of a SIG group have the samevalue than their predicted value, which might be different than zero,the zero prediction residuals do not need to be placed into the bitstream, when the corresponding significance bit(s) of the SIG group areset appropriately.

To this end, the bit stream of every precinct (or even every subband)signals which of the two significance flags is chosen. By these means,the encoder can chose for every precinct or every subband the bestalternative, giving some coding gain as explained below.

FIGS. 6.1 to 6.32 present PSNR results which were obtained using thecoding framework presented above, i.e. using the GCLI coding, combinedwith RSF coding, CSF coding or a variant allowing for a switchingbetween both coding modes. FIGS. 6.1 to 6.6 refer to coding of RGB 444 8bit, namely PSNR optimized with different bpp (bit per pixel)constraints for RSF/CSF switchability, visually optimized with bitrateconstraint of 4 bpp while comparing RSF only, CSF only and RSF/CSFswitching, respectively, PSNR optimized with bitrate constraint of 6 bppwhile comparing RSF only, CSF only and RSF/CSF switching, respectively,PSNR optimized with bitrate constraint of 12 bpp while comparing RSFonly, CSF only and RSF/CSF switching, respectively, visually optimizedwith bitrate constraint of 4 bpp while comparing RSF only, CSF only andRSF/CSF switching, respectively, and visually optimized with bitrateconstraint of 12 bpp while comparing RSF only, CSF only and RSF/CSFswitching, respectively. Similar simulation results are—as indicated atthe headlines, depicted in FIGS. 6.7 to 6.10 for RGB 444 10 bit coding,and in FIGS. 6.11 to 6.14 for YUV 422 10 bit coding. Multigenerationmaximum PSNR and mean PSNR results are presented in FIGS. 6.15 to 6.32,namely for RGB 444 8 bit in 6.15 to 6.20, for RGB 444 10 bit in 6.21 to6.26, and for YUV 422 10 bit in FIGS. 6.27 to 6.32.

In the following, some complexity aspects are discussed in connectionwith CSF and RSF. Before, however, an encoder architecture is presentedwith respect to FIG. 7. The encoder is shown in FIG. 7 using referencesign 50 in a manner using, as a starting point, a wavelet transform 10discussed previously. The wavelet transform 10 may have been obtained bya wavelet transformation by a transformer not shown in FIG. 7. In orderto encode the wavelet transform 10, encoder 50 comprises aGCLI-extractor 52 which determines the greatest coded line index percoefficient group 18. The encoder 50 operates, for instance,precinct-wise and seeks to meet a certain bitrate constrained. The GCLIextractor 52 feeds the determined GCLI values into a GCLI buffer 54 anda run/GTLI module 56. Module 56 computes the smallest GTLI causing thatall coefficient groups of a significant group are truncated to zero.More details are explained below. Module 56 forwards GCLI values and thesmallest GTLI leading to an insignificant significant group to asubsequent budget computer 58 which computes a bit budget per GTLIcandidate value. To this end, module 58 has access to, and keepsupdated, for transform coefficient lines to be operated on next incoding order, the GCLI values of a previous transform coefficient linein a buffer 60. Because the exact budget depends on the GTLI of theprevious precinct which might not be available already, module 58 onlycomputes an initial approximation of the bit budgets per GTLI candidate.To be more precise, the budget computer 58 operates on a line oftransform coefficients of the current precinct. A precinct budgetupdater 62 which is connected to the GCLI buffer 54 provides a precinctbudget update. It corrects for any deviation between the previous budgetapproximation and the actual bit budget. To this end, module 62 operateson the precinct to encode next by module 64, causing that the GTLI ofthe previous precinct is already available. Based on the precinct budgetupdate and budget values determined by computer 58, the RA module 63computes the GTLI value to effectively apply to the precinct to encodenext in order to meet the afore mentioned bitrate constraint. This GTLIvalue is provided as input to a GCLI coder 64 which, in addition,receives the GCLI values from the GCLI buffer 54. The GCLI coder 64 hasaccess to the previous line of GCLI values in form of the previous lineGCLI buffer 60 and to the GTLI of the previous line by way of a register66. GCLI coder 64 codes the GCLI values with details in this regardhaving been set out above and outputs same into a buffer 68. Thecoefficients of the transform 10 are also buffered in a buffer 70 andthose bits thereof which are in the coded bit planes as signaled in thedata stream by way of the coded GCLI values in buffer 68, are insertedinto the data stream via a coefficient encoder 72. As described above,this may be done in form of placing the bits as raw data into the datastream. A packer 74 packs the coded GCLI data and the raw data bits intothe data stream.

The blocks in FIG. 7 highlighted, namely 56, 58 and 64, are concernedwith the usage of two different types of significance flags, namely RSFand CSF. As further explained in [1] the content of which isincorporated herein by reference, the wavelet coefficients of thewavelet transform 10 are stored in the coefficient buffer 70 for laterdata coding by encoder 72. As also described in [1], the GCLI extractor52 determines the GCLI value and stores it in buffer 54.

In order to combine the two different sigflags methods, the followingvalues need to be computed per significance group such as by module 56:

$t_{i}^{CSF} = {\max\limits_{{s_{sig} \cdot i} \leq j < {s_{sig} \cdot {({i + 1})}}}\left( g_{j} \right)}$$t_{i}^{RSF} = {\max\limits_{{s_{sig} \cdot i} \leq j < {s_{sig} \cdot {({i + 1})}}}\left( {\min\left\{ {\left. t_{j} \middle| {\forall{t \geq {t_{j}\text{:}\mspace{14mu}{{PRED}\left( {g_{j},t,g_{i}^{r},t_{j}^{r}} \right)}}}} \right. = 0} \right\}} \right)}$

With

-   -   g_(j) being the GCLI j    -   t_(j) being the quantization/truncation to apply to GCLI g_(j)    -   g_(i) ^(r) being the reference GCLI used for predicting g_(j)        (hence i.e. the horizontal or vertical neighbor)    -   t_(j) ^(r) being the quantization/truncation to apply to GCLI        g_(i) ^(r)    -   PRED being the prediction function to predict the value g_(j)        from g_(i) ^(r) using t and t_(j) ^(r)    -   S_(sig) being the currently processed significance group

Given that t_(i) ^(RSF) is the same value than used in [2], thecomplexity is not further discussed. Computation of t_(i) ^(CSF) ispossible by means of a comparator (<=5 LUTs) and one register of 4 bitsper subband. Moreover, initial budget computation is simplified bydelaying the GCLI values by one significance group. For one verticalwavelet decomposition level (3·8 subbands), this may be 3.8.8.4=768bits. For Xilinx, this corresponds to 2·48=96 LUTs, or 2 MLAB blocks forAltera devices.

Another slight modification may be used in the GCLI coder: When onlyusing the residual significance flags (as in [1]), s_(sig) predictionresiduals needs to be buffered before encoding them to determine whetherall of them are zero. This allows to either output the predictionresiduals or signaling the SIG group as insignificant by means of thesignificance flags. When using t_(i) ^(CSF), the coder has to check inaddition whether all the GCLIs g_(i) to encode are all below theselected quantization/truncation parameter t_(i). This, however, istrivial, and no additional buffering is needed.

The computation of budget savings for coefficient significance flags isdone as follows.

Whenever a significance group is signaled insignificant using thecoefficient significance flags, the budget computation module in FIG. 7needs to track the number of bits saved by not placing the predictionresiduals into the bit stream.

The overall budget for both methods can hence be computed by

-   -   Computing the budget without any significance flags    -   Computing the budget savings for the residual significance flags    -   Computing the budget savings for the coefficient significance        flags

This means that the complexity increase of using both methods justconsists in computing an additional budget saving as discussed below.

Let's say vertical prediction according to the first option discussedabove applies.

For this prediction method, the following equations are usedδ_(i) ={tilde over (g)} _(i)−max(g _(i-1),max(t _(i-1) ,t _(i)))={tildeover (g)} _(i)−max({tilde over (g)} _(i-1) ,t _(i)){tilde over (g)} _(i)=max(g _(i) ,t _(i)){tilde over (g)} _(i-1)=max(g _(i-1) ,t _(i-1))  (1)

In case both the current and the reference GTLIs t_(i) and t_(i-1) areequal, equation (1) simplifies toδ_(i) ={tilde over (g)} _(i)−max(g _(i-1),max(t _(i-1) ,t _(i)))={tildeover (g)} _(i) −{tilde over (g)} _(i-1)  (2)

Knowing that the budget saving can only occur for t_(i)≥t_(i)^(CSF)≥g_(i), we obtain from equation (1):δ_(i) =t _(i)−max(g _(i-1),max(t _(i-1) ,t _(i)))

The budget savings thus uniquely depends on g_(i-1) and t_(i) ^(CSF),plus the parameters t_(i-1) and t_(i), such that it can be easilycomputed.

If the second vertical prediction option applies, the followingequations are used

$\begin{matrix}{{\delta_{i} = {{\overset{\sim}{g}}_{i} - g_{i - 1}^{*}}}{g_{i - 1}^{*} = \left\{ {{\begin{matrix}{\max\left( {g_{i - 1},t_{i}} \right)} & {g_{i - 1} > t_{i - 1}} \\t_{i} & {otherwise}\end{matrix}{\overset{\sim}{g}}_{i}} = {{{\max\left( {g_{i},t_{i}} \right)}{\overset{\sim}{g}}_{i - 1}} = {\max\left( {g_{i - 1},t_{i - 1}} \right)}}} \right.}} & (3)\end{matrix}$

In case both the current and the reference GTLIs t_(i) and t_(i-1) areequal, equation (1) simplifies toδ_(i) ={tilde over (g)} _(i) −{tilde over (g)} _(i-1)   (4)

Knowing that the budget saving can only occur for t_(i)≥t_(i)^(CSF)≥g_(i), we obtain from equation (3):

$g_{i} = {t_{i} - \left\{ \begin{matrix}{\max\left( {g_{i - 1},t_{i}} \right)} & {g_{i - 1} > t_{i - 1}} \\t_{i} & {otherwise}\end{matrix} \right.}$

The budget savings thus uniquely depends on g_(i-1) and t_(i) ^(CSF),plus the parameters t_(i-1) and t_(i), such that it can be easilycomputed.

A corresponding decoding architecture is shown in FIG. 8. The decoder ofFIG. 8 is generally indicated using reference sign 80. An inputdemultiplexer 82 receives the datastream and derives therefrom the codedcoefficient bits within the coded bit planes, namely 84, the GCLIresiduals 86 and the flags which might be RSFs or CSFs, namely 88. Thebits 84 are stored in the data buffer 90, the GCLI residual values in aGCLI buffer 92 and the flags 88 in buffer 94. As depicted in FIG. 8, theGCLI residual values stored in buffer 92 might be unary coded or codedas raw data and depending thereon, a raw decoder 96 or a unary decoder98 is used to decode the GCLI residual values. A subband GCLI buffer 100may, optionally, be accessible for decoder 96 and decoder 98,respectively. Via a GCLI packer 102, an inverse GCLI predictor 104receives the GCLI residuals and reconstructs the GCLI values based on aprevious GCLI 106 and on the basis of the RSF flag: if RSF applies, andthe RSF flag for a current GCLI is set, inverse predictor 104 isinformed on the prediction residual, i.e. the GCLI residual, being zeroanyway. The predictor determined based on the previous GCLI 106 is thenused as the current GCLI. The inverse predictor 104 outputs the GCLIdetermined and a multiplexer chooses this prediction output or a zeroreplacement depending on a CSF flag which applies for the current GCLI:if the CSF flag is set, there is no coded bitplane within thecorresponding SIG group anyway and the GCLI is set accordingly, i.e. tozero or some value leading to insignificant transform coefficientscoding considering the current GTLI. An unpacker controller 110 receivesthe output of the multiplexer 108 which, in turn, is also fed back asthe previous GCLI to the inverse predictor 104, and controls, in turn,an unpacker 112 which, depending on the current GCLI, retrievescoefficient bits of coded bit planes for the current coefficient groupfrom data buffer 90. At the output of unpacker 112, the respectivetransform coefficients result.

Accordingly, FIG. 8 shows a block diagram of a decoder and shows, inparticular, extensions in addition to [1] which enable the support ofboth significance flag types. For sake of completeness, it should benoted that FIG. 8 shows an additional GCLI packer 102 compared to [1].

In case a precinct (or subband) is encoded with residual significanceflags, the inverse predictor simply assumes a prediction residual ofzero instead of reading them from the GCLI packer 102. When using thecoefficient significance flags, the inverse predictor 104 can exactlyperform the same operation. But instead of using the outcome of thisprediction, the value is simply replaced by a zero value. Hence, inorder to handle both flag types, the decoder of FIG. 8 simply comprisesa 4 bit MUX2 element, namely 108, that is controlled by the output ofthe significance flag buffer 94 and the type of the significance flagused. The increase in logic as far as the decoder is concerned is, thus,negligible.

After having described certain embodiments of the present application asan extension or modification of the currently envisaged version of JPEGXS, further embodiments for decoder and encoder and datastream aredescribed as a kind of generalization of the embodiments discussedabove. FIG. 9 illustrates an encoder 100. The encoder of FIG. 9 is forencoding transform coefficients 16 into a datastream 102. As describedabove, the transform coefficients 16 may be transform coefficients of atransform of a picture. Transform coefficients 16 may form onesub-portion of a plurality of sub-portions of a spectral decompositionof a picture and the encoder 100 may be configured to perform theencoding on a per sub-portion basis. Such a sub-portion may be a subbandsuch as a subband of a wavelet transform, or groups of transformcoefficients relating to a corresponding spatial region of spatialregions in which the picture is subdivided such as the region 32corresponding to a precinct. It should be clear that the transformcoefficients 16 may also be coefficients of a different transform suchas, for instance, a DCT or the like. The transform coefficients aregrouped into coefficient groups 18. The number of coefficients 16 pergroup 18 may, as discussed above, be any number greater than 1 and isnot restricted to 4 illustrated in FIG. 9. The grouping of coefficients16 into groups 18 may be done in a manner so that coefficients 16belonging to one group 18 belong to the same subband. In case of awavelet transform, coefficients 16 belonging to one group 18 may, forinstance, be spatial neighbors of one subband, and in case of transformcoefficients 16 being DCT coefficients, a group 18 may be composed ofcoefficients 16 stemming from different DCT transform blocks obtainedfrom spatially neighboring regions of a picture, the coefficients of onegroup corresponding to one frequency component or coefficient withinthese DCT transform blocks. In particular, in case of a DCT transform, apicture could be transformed in units of blocks into DCT transformblocks of the same size, each coefficient position of which wouldrepresent a separate subband. For example, all DC coefficients of theseDCT transform blocks would represent the DC subband, the coefficients tothe right thereof another subband and so forth. Groups 18 could thencollect coefficients of one subband of DCT transform blocks obtainedfrom neighboring blocks of the picture.

The coefficient groups 16, in turn, are grouped into group sets 40. Thismay also be done in a manner not mixing coefficients of differentsubbands. Moreover, coefficients 16 of coefficient groups 18 within onegroup set 40 may all stem from the same subband.

The encoder 100 of FIG. 9 inserts into the datastream 102 information104 which identifies a first subset of group sets 40 for which asignificance coding mode is not to be used, i.e. group sets 40 for whichGCLI residuals are coded, and a second subset of group sets for whichthe significance coding mode is to be used, i.e. group sets 40 for whichGCLI residuals are not coded. In the description brought forward above,one CSF flag is inserted into datastream 102 for each group set 40 inorder to form information 104. The first subset of group sets 40 are thegroup sets 40 for which CSF is 0 or not set, while the second subsetincludes those group sets 40 for which CSF is 1. For setting information104 for a current group set 40, encoder 100 checks 106 whether alltransform coefficients 16 within group set 40 are insignificant, i.e.are quantized to 0. Encoder 100 may insert into datastream 102truncation information 108 indicating a set of one or more truncatedleast significant bit planes. The GTLI value discussed above may formpart of information 108. The GTLI 108 may be transmitted in datastream102 at a granularity of the afore-mentioned sub-portions, for instance,i.e. per precinct, for instance, or at some other level such as in unitsof sub-bands or coefficient group rows. As a side, it is noted that thecoefficient groups 18 may, other than exemplarily depicted in thefigures, collect coefficients 16 neighboring each other along adirection oblique to the coefficient rows 41. The GCLI values for whichthe information 118 provides the prediction residuals, may indicate themost significant bit plane to be coded into data stream 102 as an indexrelative to the GTLI which may index, in turn, the most significant oneamong the least significant bit planes up to which the magnitude bits 24shall be truncated. If all coefficients of all groups 18 within acurrent group set 40 are 0, the CSF flag for this group set 40 is set at110, and if not, is not set as shown at 112. If not set, encoder 100signals in the datastream 102 the set of coded bit planes by predictingthis set at 114 on the basis of neighboring coefficient groups 18, forinstance, and inserting 116 the prediction residual into the datastream102, thereby forming the GCLI data 118 in datastream 102. For instance,the set of coded bit planes may be signaled in datastream 102 byindexing, i.e. by indexing the greatest coded line. For coefficientgroups 18 within the current group set 40, for which the GCLI 118 isgreater than the GTLI, encoder 100 encodes the corresponding coefficientbits of coefficients 16 of the respective coefficient group 18, i.e.bits 24, into datastream 102. This bit insertion 120 may be done at acode rate of 1 such as, more concretely speaking, by inserting the bitsas raw bits. The GCLI data values, in turn, may be coded into datastream102 as a variable length code, for instance, such as a unary code asdiscussed above. The raw bits inserted at 120 are depicted in FIG. 9 at122. As already discussed above, within datastream 102, raw bits 122,GCLI data 118 and flags 104 may be interleaved or non-interleaved. Ascan be seen, CSF=1 is a very compressed way of representing group set40. After any of 110 or 120, the processing may proceed with anothergroup set 40 in the same manner.

FIG. 10 shows a decoder corresponding to the encoder of FIG. 9. Thedecoder 200 of FIG. 10 operates to reconstruct the transformcoefficients 16 from datastream 102 and to this end, checks whether theCSF for a current group set 40 is set in which case decoder 200 zeroes,i.e. sets to zero, all transform coefficients 16 within group set 40 orsynthesizes noise in this transform coefficients 16. To this end, somesort of insignificant treatment 210 is performed for the current groupset 40 if the check 206 indicates that significance coding mode is to beused for the current group set 40. If not, however, decoder 200 treatsthe group set 40 normally. That is, decoder 200 predicts at 214 the GCLIof each coefficient group 18 within the current group set 40 andcorrects 216 the prediction using the prediction residual taken fromdatastream 102. As mentioned above, variable length decoding may use forderiving the prediction residual 118. The prediction may be done usingthe GCLI of a coefficient group 18 neighboring the current coefficientgroup or the current group 40 vertically, meaning in the presentexample, that for all groups 18 within the current set 40, theprediction reference, i.e. the vertically neighboring group 18 isexternal to current set 40. Alternatively, the prediction 214 may bedone using the GCLI of a coefficient group 18 neighboring the currentcoefficient group or the current group 40 horizontally, meaning in thepresent example, that for most groups 18 within the current set 40except the outermost left one, for instance, the prediction reference,i.e. the horizontally neighboring group 18, is within current set 40.Naturally, it might be feasible to signal the prediction source for eachgroup 18 in the data stream. Even non-prediction might be a possiblemode. The details on prediction 214 are naturally, also transferable,onto prediction 114. Mode switching may alternatively by signaled andselected by the encoder at some other granularity than groups 18 or sets40, such as coefficient rows 41 or rows of groups 18, subbands orpredincts 30.

For each coefficient group 18 for which the GCLI is greater than theGTLI, i.e. for which the set of coded bit planes is not beneath thequantization threshold, as checked by decoder 200 at 218, the bits ofthe corresponding coded bit planes of the coefficients 16 within therespective coefficient group 18 are read at 220 from datastream 102.This means, decoder 200 reads or decodes bits in datastream 102, namely122, directly into those bit planes indicated by the GCLI and the GTLI,namely therebetween in accordance with a predetermined mapping rule forinserting the bits from bitstream 102 into the bit planes.

In FIG. 9, it is additionally illustrated that the encoder 100 may,optionally, signal within datastream 102 the fact that the information104 pertains to this kind of significance indication, i.e. pertains toCSFs rather than, for instance RSFs. This indication is shown as beingoptionally inserted by encoder 100 into datastream 102 at 250.

FIG. 11 shows an encoder 300 configured to use RSFs instead of CSF. Theencoder 300 of FIG. 11 operates in the following manner. In particular,the following description concentrates on the differences to theoperation of the encoder 100 of FIG. 9.

The encoder 300 of FIG. 11 operates on a current group set 40 bydetermining at 314 the GCLI predictors for all coefficient groups 18 ofthat group set 40 and determining at 316 whether all predictions exactlyfit, i.e. the prediction residuals are all 0 for all coefficient groups18 within group set 40. If this is the case, then encoder 300 signalsthis by setting RSF=1 at 318 within the significance information 104 indatastream 102. Here, indication 250 indicates that RSF signaling isconveyed in information field 104 of datastream 102 instead of CSFsignaling as indicated by indication 250 in FIG. 9. If all the GCLIprediction residuals are not 0, however, then RSF flag for this groupset 40 is set to 0 at 220 and the prediction residuals for the GCLIvalues for the coefficient groups 18 of the current group set 40 areinserted at 322 into datastream 102, namely within field 118.Irrespective whether RSF is set or not, it is checked whethernon-truncated coded bit planes exist for each coefficient group, and ifyes, they are inserted at 326 into datastream 102.

It should be noted that an encoder in accordance with a furtherembodiment could be able to operate according to both modes, i.e.according to FIG. 9 or according to FIG. 11 with choosing there among inorder to decide as to which option, RSF or CSF, may be used according tosome coding efficiency sense, for instance.

FIG. 12 shows a decoder 400 capable of dealing with a datastream 102containing the indication 250 irrespective of whether indication 250indicates the usage of CSF or RSF coding. The reference signs of FIG. 10have been reused, but information 104 is indicated as “R/CSF” instead of“CSF” in order to indicate that the meaning of the flags of information104 depends on indication 250. The insignificant treatment 210 isperformed by decoder 400 merely in case of the corresponding flag forthe current group set 40 being set and the CSF mode being indicated byindication 250, concurrently. If not, a further difference of the modeof operation compared to FIG. 10 is the fact that the predictioncorrection 216 is skipped by decoder 400 if a check 402 yields that theR/CSF flag is set for the current group set 40 and the indication 250indicates the RSF mode. If not, the prediction correction 216 isperformed.

With respect to FIG. 12, it is noted that it is remarkable that thedecoder 400 of FIG. 12 does almost not differ from the decoder of FIG.10. The capability of handling both, RSF and CSF coding, comes at almostno operational overhead. On the other hand, everybody seeking to installan encoder for generating a datastream 102 for feeding decoder 12, is,in case of indication 250 being used, provided with the opportunity tochoose among the RSF option of FIG. 11, or the CSF option of FIG. 9. Inthis regard, it should be noted that the CSF option might haveadvantages with respect to parallel processing capability, while the RSFoption of FIG. 11 might be advantageous in case of an implementation ofthe encoder in a sequential operation style such as, for instance, inform of an FPGA or the like. In particular, while the RSF settingdepends on the prediction reference bases for the prediction in step322, the CSF setting may be done independent from any other transformcoefficients, except for the necessity to know about the GTLI, i.e. thequantization.

With respect to FIGS. 9 to 12, it should be noted that the data stream102 could be provided by the encoder with information or a flag whethersignificance mode is used anyway, and depending thereon, information 104and optionally used signaling 250 could be not present in data stream102 with all group sets 40 being treated in normal mode instead.

DEFINITIONS & ABBREVIATIONS

These are some definitions that are going to be used along the document.

GCLI: Greatest Coded Line Index

GCLI Coefficient Group: Group of wavelet coefficient represented by oneGCLI value

Escape GCLI: GCLI value not used for ordinary coding that can be used tosignal a specific condition to the decoder

Significant GCLI: A GCLI whose value is larger than zero

Insignificant GCLI: A GCLI whose value is zero

GTLI: Greatest truncated line index

Truncated GCLI: The result of max(GCLI-GTLI, 0)

Insignificant Truncated GCLI: A GCLI whose value is less or equal thanthe GTLI for a coefficient group

GCLI residual: Result of the prediction applied to a GCLI value. Thisinvolves a reference GCLI and the corresponding GTLI values. There aretwo variants, horizontal and vertical prediction.

Precinct: Group of coefficients of different subbands contributing to agiven spatial region in the input image.

Scenario: Quantization parameter defined on a precinct base that can beused to derive the GTLI values for the different wavelet subbands.

RSF: Residual Significance Flags, also known as Non significance Flags[1].

SIG group: Group of GCLI coefficient groups, for which a SIG flag isassigned. Also known as significance group

CSF: Coefficient Significance Flags

REFERENCES

-   [1] EP17162866.2, Decoder for decoding image data from a data    stream, encoder for encoding image data into a data stream, and data    stream comprising image data and data on greatest coded line index    values-   [2] intoPIX, “intoPIX Codec Submission for JPEG-XS CfP, Design    Description”, wg1m73019-   [3] AMBROISE RENAUD; BUYSSCHAERT CHARLES; PELLEGRIN PASCAL; ROUVROY    GAEL, “Method and Device for display stream compression”, EP2773122    A1-   [4] AMBROISE RENAUD; BUYSSCHAERT CHARLES; PELLEGRIN PASCAL; ROUVROY    GAEL, “Method and Device for Display Stream Compression”, U.S. Pat.    No. 9,332,258 BB-   [5] Jean-Baptiste Lorent, “TICO Lightweight Codec Used in IP    Networked or in SDI Infrastructure”, SMPTE RDD 35:2016-   [6] Toshiaki Kojima, “LLVC—Low Latency Video Codec for Network    Transfer”, SMPTE RDD 34:2015-   [7] J. Kim and C. M. Kyung, “A Lossless Embedded Compression Using    Significant Bit Truncation for HD Video Coding”, IEEE Transactions    on Circuits and Systems for Video Technology, 2010

FIG. 13 shows an example for a pseudocode of a datastream 102. In thispseudocode, the indication 250 is conveyed within a parameter called“Rm”. Rm=1 indicates the usage of CSF coding mode and the skipping ofany bit derivation is urged by synthetically setting the predictionresidual Δm at 500 to such a value that the correction 502 of the GCLIpredictor computed at 504 is in any case small enough in order to notexceed the quantization threshold T as tested at 506. The skipping ofany GCLI residual reading from the datastream is done on the basis ofthe significance flag information at 508 by rendering the reading of anyprediction residual, namely Δm, dependent on the significance flags Z.Whether or not Rm is 0 or 1, does not influence this dependency of theprediction residual reading at 510 on the significance flags at 508. IfRm is 0, i.e. RSF mode is active, the prediction residual Am is set to 0at 512. The bit derivation of coded bit planes is not depicted in FIG.13 but is merely done for transform coefficient groups for which M isgreater than 0.

Although some aspects have been described in the context of anapparatus, it is clear that these aspects also represent a descriptionof the corresponding method, where a block or device corresponds to amethod step or a feature of a method step. Analogously, aspectsdescribed in the context of a method step also represent a descriptionof a corresponding block or item or feature of a correspondingapparatus. Some or all of the method steps may be executed by (or using)a hardware apparatus, like for example, a microprocessor, a programmablecomputer or an electronic circuit. In some embodiments, one or more ofthe most important method steps may be executed by such an apparatus.

The inventive encoded data stream can be stored on a digital storagemedium or can be transmitted on a transmission medium such as a wirelesstransmission medium or a wired transmission medium such as the Internet.

Depending on certain implementation requirements, embodiments of theinvention can be implemented in hardware or in software. Theimplementation can be performed using a digital storage medium, forexample a floppy disk, a DVD, a Blu-Ray, a CD, a ROM, a PROM, an EPROM,an EEPROM or a FLASH memory, having electronically readable controlsignals stored thereon, which cooperate (or are capable of cooperating)with a programmable computer system such that the respective method isperformed. Therefore, the digital storage medium may be computerreadable.

Some embodiments according to the invention comprise a data carrierhaving electronically readable control signals, which are capable ofcooperating with a programmable computer system, such that one of themethods described herein is performed.

Generally, embodiments of the present invention can be implemented as acomputer program product with a program code, the program code beingoperative for performing one of the methods when the computer programproduct runs on a computer. The program code may for example be storedon a machine readable carrier.

Other embodiments comprise the computer program for performing one ofthe methods described herein, stored on a machine readable carrier.

In other words, an embodiment of the inventive method is, therefore, acomputer program having a program code for performing one of the methodsdescribed herein, when the computer program runs on a computer.

A further embodiment of the inventive methods is, therefore, a datacarrier (or a digital storage medium, or a computer-readable medium)comprising, recorded thereon, the computer program for performing one ofthe methods described herein. The data carrier, the digital storagemedium or the recorded medium are typically tangible and/ornon-transitionary.

A further embodiment of the inventive method is, therefore, a datastream or a sequence of signals representing the computer program forperforming one of the methods described herein. The data stream or thesequence of signals may for example be configured to be transferred viaa data communication connection, for example via the Internet.

A further embodiment comprises a processing means, for example acomputer, or a programmable logic device, configured to or adapted toperform one of the methods described herein.

A further embodiment comprises a computer having installed thereon thecomputer program for performing one of the methods described herein.

A further embodiment according to the invention comprises an apparatusor a system configured to transfer (for example, electronically oroptically) a computer program for performing one of the methodsdescribed herein to a receiver. The receiver may, for example, be acomputer, a mobile device, a memory device or the like. The apparatus orsystem may, for example, comprise a file server for transferring thecomputer program to the receiver.

In some embodiments, a programmable logic device (for example a fieldprogrammable gate array) may be used to perform some or all of thefunctionalities of the methods described herein. In some embodiments, afield programmable gate array may cooperate with a microprocessor inorder to perform one of the methods described herein. Generally, themethods may be performed by any hardware apparatus.

The apparatus described herein may be implemented using a hardwareapparatus, or using a computer, or using a combination of a hardwareapparatus and a computer.

The apparatus described herein, or any components of the apparatusdescribed herein, may be implemented at least partially in hardwareand/or in software.

The methods described herein may be performed using a hardwareapparatus, or using a computer, or using a combination of a hardwareapparatus and a computer.

The methods described herein, or any components of the apparatusdescribed herein, may be performed at least partially by hardware and/orby software.

While this invention has been described in terms of several embodiments,there are alterations, permutations, and equivalents which fall withinthe scope of this invention. It should also be noted that there are manyalternative ways of implementing the methods and compositions of thepresent invention. It is therefore intended that the following appendedclaims be interpreted as including all such alterations, permutationsand equivalents as fall within the true spirit and scope of the presentinvention.

The invention claimed is:
 1. A decoder configured to decode transformcoefficients from a data stream, the transform coefficients beinggrouped into coefficient groups, the coefficient groups being groupedinto group sets, the decoder being configured to derive from the datastream an indication of a significance coding mode; derive from the datastream information which identifies a first subset of group sets forwhich a significance coding mode is not to be used, and a second subsetof group sets for which the significance coding mode is to be used; foreach group set out of the first subset, for each coefficient group ofthe respective group set, identify a first set of coded bit planes byderiving a first prediction for the first set of coded bit planes basedon a first previously decoded coefficient group, correcting the firstprediction using a first prediction residual derived from the datastream so as to acquire a corrected prediction for the first set ofcoded bit planes, deriving bits of the respective coefficient groupwithin the corrected prediction for first set of coded bit planes fromthe data stream; if the significance coding mode is a first mode, foreach group set out of the second subset, for each coefficient group ofthe respective group set, identify a second set of coded bit planes byderiving a second prediction for the second set of coded bit planesbased on a second previously decoded coefficient group, and derive bitsof the respective coefficient group within the prediction for the secondset of coded bit planes from the data stream; and if the significancecoding mode is a second mode, for each group set of the second subset,inherit that for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant. 2.The decoder according to claim 1, wherein the transform coefficientsform one sub-portion of a plurality of sub-portions of a spectraldecomposition of a picture.
 3. The decoder according to claim 2, whereinthe decoder is configured to derive from the data stream thesignificance coding mode on a per sub-portion basis.
 4. The decoderaccording to claim 3, wherein the sub-portions are sub-bands or groupsof transform coefficients relating to a corresponding spatial region ofspatial regions into which the picture is sub-divided.
 5. The decoderaccording to claim 1, configured to derive from the data streamtruncation information indicating a set of one or more truncated leastsignificant bit planes for each coefficient group, and the firstprediction, the corrected prediction and the second prediction indicatea most significant bit plane index relative to a most significanttruncated bit plane of the set of one or more truncated leastsignificant bit planes.
 6. The decoder according to claim 5, configuredto derive from the data stream the truncation information indicating theset of one or more truncated least significant bit planes at agranularity of coefficient group rows, sub-bands, or groups of transformcoefficients relating to a corresponding spatial region of spatialregions into which the picture is sub-divided.
 7. The decoder accordingto claim 1, wherein the transform coefficients are spectral coefficientsof a spectral decomposition of a picture.
 8. The decoder according toclaim 1, wherein the transform coefficients are DCT or waveletcoefficients.
 9. The decoder according to claim 1, wherein the transformcoefficients are spectral coefficients of a spectral decomposition of apicture into sub-bands, and grouped into the coefficient groups in amanner so that transform coefficients within one coefficient groupbelong to the same sub-band.
 10. The decoder according to claim 1,configured to derive the information from the data stream as one flagper group set, with group sets for which the flag assumes a first state,belonging to the first subset of group sets, and group sets for whichthe flag assumes a second state, belonging to the second subset of groupsets.
 11. The decoder according to claim 1, configured to perform thederiving of the bits at a code rate of
 1. 12. The decoder according toclaim 1, configured to set insignificant coefficients to zero or pseudonoise.
 13. A method for decoding transform coefficients from a datastream, the transform coefficients being grouped into coefficientgroups, the coefficient groups being grouped into group sets, the methodcomprising deriving from the data stream an indication of a significancecoding mode; deriving from the data stream information which identifiesa first subset of group sets for which a significance coding mode is notto be used, and a second subset of group sets for which the significancecoding mode is to be used; for each group set out of the first subset,for each coefficient group of the respective group set, identifying afirst set of coded bit planes by deriving a first prediction for thefirst set of coded bit planes based on a first previously decodedcoefficient group, correcting the first prediction using a firstprediction residual derived from the data stream so as to acquire acorrected prediction for the first set of coded bit planes, derivingbits of the respective coefficient group within the corrected predictionfor first set of coded bit planes from the data stream; if thesignificance coding mode is a first mode, for each group set out of thesecond subset, for each coefficient group of the respective group set,identifying a second set of coded bit planes by deriving a secondprediction for the second set of coded bit planes based on a secondpreviously decoded coefficient group, and deriving bits of therespective coefficient group within the prediction for the second set ofcoded bit planes from the data stream; and if the significance codingmode is a second mode, for each group set of the second subset,inheriting that for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant. 14.A non-transitory digital storage medium having a computer program storedthereon to perform the method for decoding transform coefficients from adata stream, the transform coefficients being grouped into coefficientgroups, the coefficient groups being grouped into group sets, the methodcomprising deriving from the data stream an indication of a significancecoding mode; deriving from the data stream information which identifiesa first subset of group sets for which a significance coding mode is notto be used, and a second subset of group sets for which the significancecoding mode is to be used; for each group set out of the first subset,for each coefficient group of the respective group set, identifying afirst set of coded bit planes by deriving a first prediction for thefirst set of coded bit planes based on a first previously decodedcoefficient group, correcting the first prediction using a firstprediction residual derived from the data stream so as to acquire acorrected prediction for the first set of coded bit planes, derivingbits of the respective coefficient group within the corrected predictionfor first set of coded bit planes from the data stream; if thesignificance coding mode is a first mode, for each group set out of thesecond subset, for each coefficient group of the respective group set,identifying a second set of coded bit planes by deriving a secondprediction for the second set of coded bit planes based on a secondpreviously decoded coefficient group, and deriving bits of therespective coefficient group within the prediction for the second set ofcoded bit planes from the data stream; and if the significance codingmode is a second mode, for each group set of the second subset,inheriting that for each coefficient group of respective group set,coefficients of the respective coefficient group are insignificant, whensaid computer program is run by a computer.